FactorAnalysisPersonality.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "FactorAnalysisPersonality.ipynb",
      "provenance": [],
      "toc_visible": true,
      "include_colab_link": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    }
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/rkn2/factorAnalysisExample/blob/master/FactorAnalysisPersonality.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "qTHBjB_hPxZ1",
        "colab_type": "text"
      },
      "source": [
        "# Background on the data"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "814cvzSKQBjL",
        "colab_type": "text"
      },
      "source": [
        "A personality test is given to a large group of people. There are 5 questions which deal with agreeableness (A1-5), 5 questions which deal with conscientiousness (C1-5), 5 questions which deal with Extraversion(E1-5), 5 questions which deal with Neuroticism (N1-5) and 5 questions which deal with Openness (O1-5). \n",
        "\n",
        "Those answers are directly related with one another.\n",
        "\n",
        "We want to see if based on people's answers, we can regroup those categories.\n",
        "If we can, we will end up with 5 factors and each factor will be influenced by the questions which correspond to it. \n",
        "\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "nYeZzHCmllHU",
        "colab_type": "text"
      },
      "source": [
        "# Pre-processing our data\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "dkYopb1bx4G7",
        "colab_type": "text"
      },
      "source": [
        "## Loading the data"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "bANTW6kuUClT",
        "colab_type": "text"
      },
      "source": [
        "This step just installs any packages we will need to run the analysis code. You don't have to worry about any specifics here."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "tP4cR7ZrSuLc",
        "colab_type": "code",
        "outputId": "611e1c92-4bc6-4193-d21b-5b717b8bf307",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 207
        }
      },
      "source": [
        "# Import required libraries\n",
        "import pandas as pd\n",
        "from sklearn.datasets import load_iris\n",
        "#!pip install factor_analyzer\n",
        "!pip install factor_analyzer==0.2.3\n",
        "from factor_analyzer import FactorAnalyzer\n",
        "import matplotlib.pyplot as plt\n",
        "import numpy as np\n",
        "\n",
        "\n",
        "!pip install -U -q PyDrive\n",
        "from pydrive.auth import GoogleAuth\n",
        "from pydrive.drive import GoogleDrive\n",
        "from google.colab import auth\n",
        "from oauth2client.client import GoogleCredentials\n",
        "# Authenticate and create the PyDrive client.\n",
        "auth.authenticate_user()\n",
        "gauth = GoogleAuth()\n",
        "gauth.credentials = GoogleCredentials.get_application_default()\n",
        "drive = GoogleDrive(gauth)"
      ],
      "execution_count": 2,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Collecting factor_analyzer==0.2.3\n",
            "  Downloading https://files.pythonhosted.org/packages/79/1b/84808bbeee0f3a8753c3d8034baf0aa0013cf08957eff750f366ce83f04a/factor_analyzer-0.2.3-py2.py3-none-any.whl\n",
            "Requirement already satisfied: numpy in /usr/local/lib/python3.6/dist-packages (from factor_analyzer==0.2.3) (1.16.5)\n",
            "Requirement already satisfied: pandas in /usr/local/lib/python3.6/dist-packages (from factor_analyzer==0.2.3) (0.24.2)\n",
            "Requirement already satisfied: scipy in /usr/local/lib/python3.6/dist-packages (from factor_analyzer==0.2.3) (1.3.1)\n",
            "Requirement already satisfied: pytz>=2011k in /usr/local/lib/python3.6/dist-packages (from pandas->factor_analyzer==0.2.3) (2018.9)\n",
            "Requirement already satisfied: python-dateutil>=2.5.0 in /usr/local/lib/python3.6/dist-packages (from pandas->factor_analyzer==0.2.3) (2.5.3)\n",
            "Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.6/dist-packages (from python-dateutil>=2.5.0->pandas->factor_analyzer==0.2.3) (1.12.0)\n",
            "Installing collected packages: factor-analyzer\n",
            "Successfully installed factor-analyzer-0.2.3\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "i5os7BeoT8zV",
        "colab_type": "text"
      },
      "source": [
        "Now we will load the data. This line reads in the comma separated value sheet.\n",
        "\n",
        "If you are given sensor data in excel and want to export it to csv in the future, see this link:\n",
        "https://www.ablebits.com/office-addins-blog/2014/04/24/convert-excel-csv/"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab_type": "code",
        "id": "kX8bxB9mpiYp",
        "colab": {}
      },
      "source": [
        "#url = 'https://raw.githubusercontent.com/rkn2/factorAnalysisExample/master/testDataSmall.csv' #you can change this link depending on your data\n",
        "url = 'https://raw.githubusercontent.com/rkn2/factorAnalysisExample/master/bfi%20(1).csv'\n",
        "df = pd.read_csv(url)\n",
        "#df= pd.read_csv(\"testDataSmall.csv\") # you can also just upload data using the interface on the left and use this reader here."
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "r_MFE9oIs5KZ",
        "colab_type": "text"
      },
      "source": [
        "## Cleaning the data"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "ed6U4YqqVfvn",
        "colab_type": "text"
      },
      "source": [
        "Now we can start to process our data and remove any columns we don't want. We don't need the 'true ground water' 'wind driven rain' 'corSet', or 'notCor' columns since those were only needed to generate the synthetic data.\n",
        "\n",
        "Additionally, we want to remove anywhere that there is missing data."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "cbE21AiDU_5L",
        "colab_type": "code",
        "outputId": "2a0c7e8c-e5f4-4a9e-f4ba-12ef316d9f9e",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 544
        }
      },
      "source": [
        "#index columns\n",
        "df.columns\n",
        "\n",
        "#drop unnecessary columns\n",
        "unnecessaryColumns = ['gender','age','education']#this list is the only thing you would need to change\n",
        "#unnecessaryColumns = ['corSet', 'notCor', 'true ground water', 'wind driven rain'] #this list is the only thing you would need to change\n",
        "df.drop(unnecessaryColumns,axis=1,inplace=True) \n",
        "\n",
        "#drop any missing value rows\n",
        "df.dropna(inplace=True)\n",
        "\n",
        "#view information if you want\n",
        "df.info()\n",
        "#df.head()\n",
        "\n",
        "#calcualte the number of variables\n",
        "numVars = df.shape[1]-len(unnecessaryColumns)\n"
      ],
      "execution_count": 5,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "<class 'pandas.core.frame.DataFrame'>\n",
            "Int64Index: 2436 entries, 0 to 2799\n",
            "Data columns (total 26 columns):\n",
            "Unnamed: 0    2436 non-null int64\n",
            "A1            2436 non-null float64\n",
            "A2            2436 non-null float64\n",
            "A3            2436 non-null float64\n",
            "A4            2436 non-null float64\n",
            "A5            2436 non-null float64\n",
            "C1            2436 non-null float64\n",
            "C2            2436 non-null float64\n",
            "C3            2436 non-null float64\n",
            "C4            2436 non-null float64\n",
            "C5            2436 non-null float64\n",
            "E1            2436 non-null float64\n",
            "E2            2436 non-null float64\n",
            "E3            2436 non-null float64\n",
            "E4            2436 non-null float64\n",
            "E5            2436 non-null float64\n",
            "N1            2436 non-null float64\n",
            "N2            2436 non-null float64\n",
            "N3            2436 non-null float64\n",
            "N4            2436 non-null float64\n",
            "N5            2436 non-null float64\n",
            "O1            2436 non-null float64\n",
            "O2            2436 non-null int64\n",
            "O3            2436 non-null float64\n",
            "O4            2436 non-null float64\n",
            "O5            2436 non-null float64\n",
            "dtypes: float64(24), int64(2)\n",
            "memory usage: 513.8 KB\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "gn7I2_5StNZ1",
        "colab_type": "text"
      },
      "source": [
        "# Check that factor analysis applies\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "dDVz8CyFWwh5",
        "colab_type": "text"
      },
      "source": [
        "Factor analysis code based on: https://www.datacamp.com/community/tutorials/introduction-factor-analysis"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "fPO4G7tHyBbg",
        "colab_type": "text"
      },
      "source": [
        "## Bartlett's test"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "NrqV1ZNGWIc7",
        "colab_type": "text"
      },
      "source": [
        "\n",
        "\n",
        "The first way we can do this is using *bartlett's test* which checks whether the data is *statistically significant* by checking whether or not the observed variabels intercorrelate at all using the observed correlation matrix against the identity matrix. If the test is found statistically insignificant, you should not use factor analysis. "
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "aXtTewA1WHwR",
        "colab_type": "code",
        "outputId": "3b7b6a91-717d-4ad4-e23b-2ee1316d3bb4",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        }
      },
      "source": [
        "#this is not something you need to change\n",
        "from factor_analyzer.factor_analyzer import calculate_bartlett_sphericity\n",
        "chi_square_value,p_value=calculate_bartlett_sphericity(df)\n",
        "chi_square_value, p_value"
      ],
      "execution_count": 6,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "(18184.306307820552, 0.0)"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 6
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "HdtI64_7WuSW",
        "colab_type": "text"
      },
      "source": [
        "In this Bartlett ’s test, the p-value is 0. The test was statistically significant, indicating that the observed correlation matrix is not an identity matrix."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "p0IHvEg4yE9V",
        "colab_type": "text"
      },
      "source": [
        "## Kaiser-Meyer-Olkin test"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "jOOzLoLEWohJ",
        "colab_type": "text"
      },
      "source": [
        "The second step we can do is the *Kaiser-Meyer-Olkin (KMO*) Test which measures the *suitability of data for factor analysis*. It determines the adequacy for each observed variable and for the complete model. KMO estimates the proportion of variance among all the observed variable. Lower proportion id more suitable for factor analysis. KMO values range between 0 and 1. Value of KMO less than 0.6 is considered inadequate."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "gJbu2WwCXBa0",
        "colab_type": "code",
        "outputId": "17522ec2-a2c3-4a8c-cb99-97e23c603420",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        }
      },
      "source": [
        "#this is not something you need to change\n",
        "from factor_analyzer.factor_analyzer import calculate_kmo\n",
        "kmo_all,kmo_model=calculate_kmo(df)\n",
        "\n",
        "kmo_model"
      ],
      "execution_count": 7,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.8483267027192358"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 7
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "ZK-I2yJrXEgB",
        "colab_type": "text"
      },
      "source": [
        "The overall KMO for our data is 0.85, which is excellent. This value indicates that you can proceed with your planned factor analysis."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "QmEB220wyL85",
        "colab_type": "text"
      },
      "source": [
        "# Applying factor analysis"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "KuLv3yjyyPWr",
        "colab_type": "text"
      },
      "source": [
        "## Choosing the number of factors"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "mtR0FtQGXHRA",
        "colab_type": "text"
      },
      "source": [
        "Now we need to choose the number of factors. For this, we can use the Kaiser criterion and scree plot. Both are based on eigen values. "
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "Z6zPLCYTXNgL",
        "colab_type": "code",
        "outputId": "37c538c0-50ca-4b5d-b43d-177486fd110f",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 855
        }
      },
      "source": [
        "# Create factor analysis object and perform factor analysis\n",
        "fa = FactorAnalyzer()\n",
        "fa.analyze(df, numVars, rotation=None) \n",
        "# Check Eigenvalues\n",
        "ev, v = fa.get_eigenvalues()\n",
        "ev"
      ],
      "execution_count": 8,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>Original_Eigenvalues</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>5.134580</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>2.753375</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>2.148142</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>1.852506</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>1.548463</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>5</th>\n",
              "      <td>1.110662</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>6</th>\n",
              "      <td>0.980677</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>7</th>\n",
              "      <td>0.824309</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>8</th>\n",
              "      <td>0.795162</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>9</th>\n",
              "      <td>0.718290</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>10</th>\n",
              "      <td>0.686026</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>11</th>\n",
              "      <td>0.676149</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>12</th>\n",
              "      <td>0.651776</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>13</th>\n",
              "      <td>0.622974</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>14</th>\n",
              "      <td>0.596231</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>15</th>\n",
              "      <td>0.562446</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>16</th>\n",
              "      <td>0.543299</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>17</th>\n",
              "      <td>0.514340</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>18</th>\n",
              "      <td>0.494372</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>19</th>\n",
              "      <td>0.482639</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>20</th>\n",
              "      <td>0.448655</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>21</th>\n",
              "      <td>0.422806</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>22</th>\n",
              "      <td>0.400285</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>23</th>\n",
              "      <td>0.387738</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>24</th>\n",
              "      <td>0.381837</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>25</th>\n",
              "      <td>0.262263</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "    Original_Eigenvalues\n",
              "0               5.134580\n",
              "1               2.753375\n",
              "2               2.148142\n",
              "3               1.852506\n",
              "4               1.548463\n",
              "5               1.110662\n",
              "6               0.980677\n",
              "7               0.824309\n",
              "8               0.795162\n",
              "9               0.718290\n",
              "10              0.686026\n",
              "11              0.676149\n",
              "12              0.651776\n",
              "13              0.622974\n",
              "14              0.596231\n",
              "15              0.562446\n",
              "16              0.543299\n",
              "17              0.514340\n",
              "18              0.494372\n",
              "19              0.482639\n",
              "20              0.448655\n",
              "21              0.422806\n",
              "22              0.400285\n",
              "23              0.387738\n",
              "24              0.381837\n",
              "25              0.262263"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 8
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "AYqhbUM5XQLR",
        "colab_type": "text"
      },
      "source": [
        "Here, you can see only for 6-factors eigenvalues are greater than one. It means we need to choose only 6 factors (or unobserved variables). But this is only a first step metric, next we can generate a Scree plot to see which of those 6 are really distinct from the pack."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "8EcInPmvXS4E",
        "colab_type": "code",
        "outputId": "6589d02c-5353-457b-a17b-c79dd90408d2",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 295
        }
      },
      "source": [
        "# Create scree plot using matplotlib\n",
        "plt.scatter(range(1,df.shape[1]+1),ev)\n",
        "plt.plot(range(1,df.shape[1]+1),ev)\n",
        "plt.title('Scree Plot')\n",
        "plt.xlabel('Factors')\n",
        "plt.ylabel('Eigenvalue')\n",
        "plt.grid()\n",
        "plt.show()"
      ],
      "execution_count": 9,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAXwAAAEWCAYAAABliCz2AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAIABJREFUeJzt3Xl8VPW9//HXJ3tCCEkEIiTRgPai\nVq0ItkW0BXtv0W4utb3666K9Ku1t7fKrpYL93V/13lat3tbl19XaVrso1aq4XXfBfWMVEMFdCPsS\nSMg++fz+mBNIYBIGkpOZzHk/H495ZObMmXO+X0bf5zvf8z3fY+6OiIhkvqxUF0BERAaGAl9EJCIU\n+CIiEaHAFxGJCAW+iEhEKPBFRCJCgS8SMjOrMTM3s5xUl0WiTYEvg46ZnWRmz5vZdjPbambPmdkJ\nKS7TFDPrMLMGM6s3s5Vm9rUD2M7lZvbXMMooohaHDCpmVgI8APw7cAeQB5wMtOzndnLcvb2fi7fW\n3avMzIDTgX+Y2UtAYz/vR+SAqIUvg80/Abj77e4ec/cmd3/U3V/tXMHMLjKzFUFL+zUzOz5Y/q6Z\nXWpmrwI7zSzHzEab2V1mtsnM3jGz73TZTpaZzTSzt8xsi5ndYWbl+yqgx80BtgFH7fl+sM/7gl8n\nb5rZRcHyU4HLgH8Nfiks6eO/lUg3CnwZbFYBMTO71cxOM7Oyrm+a2ReAy4GvAiXA54AtXVY5F/g0\nUAp0APcDS4BK4BPA98xsWrDut4EzgI8Do4kH+K/2VcDgQHFmsI+lCVaZDawJtnk2cKWZneLuDwNX\nAn9392J3/9C+9iWyPxT4Mqi4+w7gJMCB3wObgtZyRbDKhcA17v5K0NJ+093f67KJG919tbs3AScA\nI9z9P9291d3fDrZ5TrDuN4Afufsad28hfiA5u5eTr6PNrA7YDPwY+Iq7r+y6gplVA5OBS9292d0X\nAzcTP0CJhEp9+DLouPsK4HwAMzsC+CtwPfHWezXwVi8fX93l+aHsDulO2cAzXd6/x8w6urwfAyqA\n2gTbXuvuVfso/mhgq7vXd1n2HjBxH58T6TMFvgxq7v66md0CfD1YtBo4rLePdHm+GnjH3T/Qw7qr\ngX9z9+f6XNDd1gLlZja0S+gfwu4DiKavldCoS0cGFTM7wswuMbOq4HU18Zb9i8EqNwM/MLMJFne4\nmR3aw+ZeBuqDE7mFZpZtZkd3GeL5W+CnnZ83sxFmdnpfyu/uq4HngavMrMDMjgUuIP4rBWADUGNm\n+n9T+p3+o5LBph74CPCSme0kHvTLgEsA3P1O4KfAbcG6c4CEI2vcPQZ8BjgOeId43/vNwLBglRuA\n+4BHzaw+2NdH+qEO5wI1xFv79wA/dvfHg/fuDP5uMbOF/bAvkV1MN0AREYkGtfBFRCJCgS8iEhEK\nfBGRiFDgi4hERFqNwx8+fLjX1NQAsHPnToYMGZLaAg2wqNU5avUF1TkqBrLOCxYs2OzuI5JZN60C\nv6amhvnz5wMwb948pkyZktoCDbCo1Tlq9QXVOSoGss5m9t6+14pTl46ISEQo8EVEIkKBLyISEQp8\nEZGIUOCLiESEAl9EJCLSaljmgZizqJZrH1nJ2romRpcWMmPaOM4YX5nqYomIpJ1BHfhzFtUy6+6l\nNLXFAKita2LW3fFbiCr0RUS6G9RdOtc+snJX2Hdqaotx7SMre/iEiEh0DerAX1vXtF/LRUSibFAH\n/ujSwv1aLiISZaEGvpm9a2ZLzWyxmc3v7+3PmDaOwtzsbssKc7OZMW1cf+9KRGTQG4iTtlPdfXMY\nG+48MXv5fcupa2qjYmg+sz51pE7YiogkMKhH6UA89EcMzedLN7/E9eeMZ9JhB6W6SCIiaSnUm5ib\n2TvANsCB37n7TQnWmQ5MB6ioqJgwe/ZsABoaGiguLk5qPxsbO/jh001ccHQeJ1fl9lfxB9z+1DkT\nRK2+oDpHxUDWeerUqQvcfWJSK7t7aA+gMvg7ElgCfKy39SdMmOCd5s6d68lqaYv5mJkP+M8fXZn0\nZ9LR/tQ5E0Stvu6qc1QMZJ2B+Z5kJod60tbda4O/G4F7gA+HsZ+8nCwOLilgzdbGMDYvIpIRQgt8\nMxtiZkM7nwOfBJaFtb+qsiLWbNP4exGRnoR50rYCuMfMOvdzm7s/HNbOqsoLefGtLWFtXkRk0Ast\n8N39beBDYW1/T1VlRazbUUtrewd5OYP6ejIRkVBkTDJWlxXiDuu2q1tHRCSRjAn8qrIiAFZvVeCL\niCSSMYFfXR6fP2fNNo3UERFJJGMC/+CSArKzjNUKfBGRhDIm8HOysxg1rEBDM0VEepAxgQ9QrbH4\nIiI9yqjAryorZLWuthURSSijAr+6vIiN9S0073HbQxERybDAryqLj9Sp1S0ORUT2klGBX10eH4uv\nfnwRkb1lVOB3tvDVjy8isreMCvyRQwvIzTa18EVEEsiowM/OMipLC3W1rYhIAhkV+BCfU2e1Wvgi\nInvJuMCvLi+kVi18EZG9ZFzgV5UVsbmhlcbW9lQXRUQkrWRg4Adj8dWtIyLSTQYGfjAvvrp1RES6\nybjAry7rnBdfLXwRka4yLvBHDM0nPydLgS8isoeMC3wzo1KzZoqI7CXjAh80L76ISCIZGfhVZYU6\naSsisocMDfwi6hrbqG9uS3VRRETSRkYGfnW5RuqIiOwpIwO/cyy+Al9EZLeMDPzdY/HVjy8i0ikj\nA798SB6Fudms3qoWvohIp4wMfDOjulzz4ouIdJWRgQ+aF19EZE8ZHPhq4YuIdBV64JtZtpktMrMH\nwt5XV9VlRdQ3t7O9UWPxRURgYFr43wVWDMB+uumcF19X3IqIxIUa+GZWBXwauDnM/SRSXa6x+CIi\nXYXdwr8e+CHQEfJ+9lKlsfgiIt2Yu4ezYbPPAJ9y92+a2RTgB+7+mQTrTQemA1RUVEyYPXs2AA0N\nDRQXFx/w/t2dbz7RyOTROXz5qPwD3s5A6mudB5uo1RdU56gYyDpPnTp1gbtPTGpldw/lAVwFrAHe\nBdYDjcBfe/vMhAkTvNPcuXO9r6Zd95T/259e7vN2Bkp/1HkwiVp93VXnqBjIOgPzPclcDq1Lx91n\nuXuVu9cA5wBPuvuXw9pfIlWaF19EZJeMHYcP8VkzV29r7PzFISISaQMS+O4+zxP034etqqyIxtYY\n2zQWX0Qkw1v4GqkjIrJLRgd+57z4mjVTRCTTA79cLXwRkU4ZHfglBbkMK8zV9AoiImR44EPnrJnq\n0hERyfjAry4rYvVWtfBFRDI+8Dtb+BqLLyJRl/GBX11eREt7B5sbWlNdFBGRlMr4wNe8+CIicRkf\n+JoXX0QkLuMDv7I0aOHrxK2IRFzGB/6Q/BzKh+SphS8ikZfxgQ/xOXV0ta2IRF0kAl/z4ouIRCXw\nywup3dZER4fG4otIdEUj8MuKaI11sLG+JdVFERFJmUgEvubFFxGJSODvmhdfgS8iERaRwA9a+LoR\niohEWCQCvyA3mxFD8zVSR0QiLRKBD/FWvrp0RCTKIhP41RqLLyIRF5nAryorZG1dEzGNxReRiEoq\n8M2swsz+YGYPBa+PMrMLwi1a/6ouL6K9w1m/oznVRRERSYlkW/i3AI8Ao4PXq4DvhVGgsOyaF1+z\nZopIRCUb+MPd/Q6gA8Dd24FYaKUKQedYfPXji0hUJRv4O83sIMABzOyjwPbQShWC0aUFmOlqWxGJ\nrpwk1/s+cB9wmJk9B4wAzg6tVCHIz8mmYmgBq3XxlYhEVFKB7+4LzezjwDjAgJXu3hZqyUJQXa55\n8UUkupIKfDP76h6Ljjcz3P3PIZQpNFVlRbz8ztZUF0NEJCWS7dI5ocvzAuATwEJgUAV+dVkh9y5u\noi3WQW52ZC5BEBEBku/S+XbX12ZWCswOpUQhqiorosNhXV0zhxxUlOriiIgMqANt5u4ExvS2gpkV\nmNnLZrbEzJab2RUHuK9+U6V58UUkwpLtw7+fYEgm8YPEUcAd+/hYC3CKuzeYWS7wrJk95O4vHnBp\n+6i6XGPxRSS6ku3D/+8uz9uB99x9TW8fcHcHGoKXucEjpRPZHDysgCzTjVBEJJosnsshbdwsG1gA\nHA78yt0vTbDOdGA6QEVFxYTZs+OnBhoaGiguLu73Ml0yr5F/Ks/i68cW9Pu2+yqsOqerqNUXVOeo\nGMg6T506dYG7T0xm3V5b+GZWT+JWuRFvxJf09nl3jwHHBSd57zGzo9192R7r3ATcBDBx4kSfMmUK\nAPPmzaPzeX86fOULtHU4U6ac2O/b7quw6pyuolZfUJ2jIl3r3Gvgu/vQ/tiJu9eZ2VzgVGDZvtYP\nU1VZEc+9uTmVRRARSYn9GqVjZiPN7JDOxz7WHRG07DGzQuBfgNcPvKj9o7q8kA31zbS0D6q530RE\n+izZ+fA/Z2ZvAO8ATwHvAg/t42OjgLlm9irwCvCYuz/Qh7L2i6qyItxhbZ3mxReRaEl2lM5/AR8F\nHnf38WY2Ffhybx9w91eB8X0sX7+r7jIWf8zwISkujYjIwEm2S6fN3bcAWWaW5e5zgaTOCqebqmAs\nvmbNFJGoSTbw68ysGHga+JuZ3UD8attB56W3tgBw2T1LmXz1k8xZVJviEomIDIxkA/90oBH438DD\nwFvAZ8MqVFjmLKrlR3N2DxKqrWti1t1LFfoiEgnJBv7XgVHu3u7ut7r7jUEXz6By7SMraWrrPjqn\nqS3GtY+sTFGJREQGTrKBPxR41MyeMbOLzawizEKFZW1d4n77npaLiGSSpALf3a9w9w8C3yI+3PIp\nM3s81JKFYHRp4X4tFxHJJPs7PfJGYD2wBRjZ/8UJ14xp4yjMze62LC87ixnTxqWoRCIiAyfZC6++\naWbzgCeAg4CL3P3YMAsWhjPGV3LVWcdQGbToswzGjhjCGeMrU1wyEZHwJXvhVTXwPXdfHGZhBsIZ\n4yt3Bfxvn3qLqx96nYXvb+P4Q8pSXDIRkXAl24c/C1hqZqOTnUtnMPjKRw+lfEgeNzz+RqqLIiIS\numS7dC4GNgCPAQ8Gj5TPi9NXQ/JzuOjksTy1ahOL3t+W6uKIiIQq2ZO23wPGufsH3f2Y4DHo+vAT\n+eqkQykryuWGJ9TKF5HMlmzgrwa2h1mQVBmSn8NFHxvLvJWbWLy6LtXFEREJTbKB/zYwz8xmmdn3\nOx9hFmwgfXVSTbyV//iqVBdFRCQ0yQb++8T77/OIX3Xb+cgIxfk5XHjyWOaqlS8iGSypYZnufgWA\nmRW5e2O4RUqN806s4ffPvM2NT7zBH88/IdXFERHpd8mO0plkZq8R3KLQzD5kZr8OtWQDrDgYsfPk\n6xtZola+iGSgZLt0rgemEZ9SAXdfAnwsrEKlylcnHUppUS43asSOiGSgpOfScffVeyzKuLuADy3I\n5cKTxvDE6xt5dY1a+SKSWZIelmlmJwJuZrlm9gNgRYjlSpnzTqxhWKFa+SKSeZIN/G8Qnxq5EqgF\njgteZ5zOVv7jKzaydE1GXnogIhGV7Fw6m939S+5e4e4j3f3Lg/GOV8k6b3K8la+rb0UkkyQ1LNPM\nbkyweDsw393v7d8ipV5J0Mr/+WOrWFa7naMrh6W6SCIifZZsl04B8W6cN4LHsUAVcIGZXR9S2VLq\nvMk1lBTkqJUvIhkj2fnwjwUmu3sMwMx+AzwDnAQsDalsKVVSkMuFJ4/lF2rli0iGSLaFXwYUd3k9\nBCgPDgAt/V6qNHH+5BoKc7M5+7fPM2bmg0y++knmLKpNdbFERA5Isi38a4DFwW0OjfhFV1ea2RBg\n0N3MPFlPrthIW6yD9g4HoLauiVl3x3/Q6LaIIjLYJDtK5w/AicAc4B7gJHe/2d13uvuMMAuYStc+\nsnJX2Hdqaotx7SMrU1QiEZED12vgm9kRwd/jgVHE58VfDRwcLMtoa+ua9mu5iEg621eXziXARcDP\nE7znwCn9XqI0Mrq0kNoE4T5qWEEKSiMi0je9Br67XxT8nTowxUkvM6aNY9bdS2lq6z5t0OEji3F3\nzCxFJRMR2X/76tL5YZfnX9jjvSv38dlqM5trZq+Z2XIz+27fijrwzhhfyVVnHUNlaSEGjB5WwMf/\naQRPv7GZ/7h3GR179O+LiKSzfXXpnEN8hA7ALODOLu+dClzWy2fbgUvcfaGZDQUWmNlj7v7aAZc2\nBc4YX9ltRI67c/XDr/O7p96mPeZceeYxZGWppS8i6W9fgW89PE/0uht3XwesC57Xm9kK4pOvDarA\n35OZMfPUI8jNyuKXc9+kvcP52eePJVuhLyJpztx77pYws4XufvyezxO97nUnZjXA08DR7r5jj/em\nA9MBKioqJsyePRuAhoYGiouLSVfuzr1vtTHnzTYmjc7mwqPz+xz66V7n/ha1+oLqHBUDWeepU6cu\ncPeJSa3s7j0+iN/kZAdQT7yLZkeX1229fbbLNoqBBcBZ+1p3woQJ3mnu3Lk+GPzyyTf80Esf8Itv\nW+it7bE+bWuw1Lm/RK2+7qpzVAxknYlPYrnPLHb3fY7SyT7Agw4AZpYL3AX8zd3v7su20tW3ph5O\nTpZx1UOv0x7r4IZzxpOXk/SNxEREBkyyUyvsN4uPWfwDsMLdfxHWftLB1z9+GNlZxk8eXMHq3zzH\n1oZW1m1vZnRpITOmjdM0DCKSFkILfGAy8BVgqZktDpZd5u7/E+I+U+bCk8eyYt0O7lq4e3I1zb0j\nIukktMB392fZx0ieTPPi21v3WtY5944CX0RSTZ3N/Uhz74hIOlPg96PRpYUJl2vuHRFJBwr8fjRj\n2jgKc/ce2FRalEdLeyzBJ0REBo4Cvx/tOfdOZWkhX5xYxWvrdvDNvy5U6ItISoU5SieS9px7B+DY\nqlL+z5xlfOtvi/j1l47XOH0RSQklzwD48kcP5b9O/yCPr9jAt25bSGt7R6qLJCIRpMAfIF+ZVMMV\nn/sgj722gW/fvpC2mEJfRAaWAn8AnXdiDT/+7FE8snwD37l9kUJfRAaUAn+AfW3yGP7jM0fx0LL1\nfHe2Ql9EBo5O2qbABSeNwd35yYMrMFvMKeNG8ovHVnFOdT0/uvpJzb8jIqFQ4KfIhSePxR1++j8r\neHjpemLuUK35d0QkPOrSSaGLPjaWkoKceNgDnbfI7Zx/R0SkPynwU6y+uX3X8xc37p5rTvPviEh/\nU+CnWNf5d17cmJVwuYhIf1Dgp1jX+XeGBGdUCnKymDFtXApLJSKZSIGfYl3n35lWFR+i+eEx5Tph\nKyL9ToGfBs4YX8lzM0/hs0eUcN6kQ3n6jc08/+bmVBdLRDKMAj/NzDztSMYOH8IP7lzCjua2VBdH\nRDKIAj/NFOZl84t/PY4N9S1cft/yVBdHRDKIAj8NHVddyremHMbdC2t5eNm6VBdHRDKEAj9NffsT\nH+DoyhIuu2cZm+pbUl0cEckACvw0lZudxXVfPI6GlnZm3f0qHlyNKyJyoBT4aewDFUP54bRxPL5i\nI3fOX5Pq4ojIIKfAT3P/NnkMHx1bzhX3L2f11sZUF0dEBjEFfprLyjL++wsfwsy45M4lxDrUtSMi\nB0aBPwhUlRXx488excvvbOWPz76T6uKIyCClwB8kzp5QxSePquDaR1aycn19qosjIoOQboAySJgZ\nV551DNOue5oLbnmFDnfWbW9mdGmh7pAlIklRC38QGV6czxnjK1lT18Ta7c04u++QNWdRbaqLJyJp\nToE/yDy8bP1ey3SHLBFJhgJ/kOnpTli1ukOWiOxDaIFvZn80s41mtiysfURRb3fC+v4di1m6ZvsA\nlkZEBpMwW/i3AKeGuP1I6nqHrE75OVmcfPhwHl62ns/+8lnO/s3zPPDqWtpi8RuqzFlUy+Srn2TM\nzAeZfPWT6u8XiajQRum4+9NmVhPW9qOqczTOtY+sZG1dU7dROjua27hz/hpuff5dLr5tEaOGFXD8\nIWU8sWIDze3x8O88ydt1WyISDRqWOQidMb4yYViXFORywUljOP/EGuat3MifnnuXB5fuPb1y50le\nBb5ItFiYszAGLfwH3P3oXtaZDkwHqKiomDB79mwAGhoaKC4uDq1s6SiMOs97azuLtmSxfJvR7nBk\nqTNpZAdl+XBM5bB+3df+0nccDapzuKZOnbrA3Scms27KA7+riRMn+vz58wGYN28eU6ZMCa1s6SiM\nOk+++smEI3iK8rJ5/Psf7/UkcNj0HUeD6hwuM0s68DUsM8MlOsmbnWW0tHcw5dp5XH7fct1gRSQi\nwhyWeTvwAjDOzNaY2QVh7Ut6dsb4Sq466xgqSwsxoLK0kJ9/4UM8NWMKZ46v5C8vvsfHrpnLzx5+\nnbrG1lQXV0RCFOYonXPD2rbsn55O8v7s7GP5xpTDuO6xVfz2qbf46wvvceHJY6koyef/PfnmXqOA\nRGRw0yidiBszfAg3njueb049jF88uorrHl/V7f1khnHOWVSbcJioiKQXBb4AcMTBJdz01Ymc8JPH\n2dTQvU+/qS3GpXe9ytyVGxk5NJ+RQwsYWZLPiOJ8Xq3dzvWPrdI4f5FBQIEv3WxuSHwCt6W9g4Xv\nb2PjjhZagnDvSVNbjKsfel2BL5JmFPjSzejSwoTDOCtLC3nmh6fg7uxobmdTfQsb65v5X79/KeF2\n1u9o5pPXPcWksQcx6bDhfHRsOaVFecDuLqBzquv50dVPqgtIZIAo8KWbGdPGMevupTS1xXYtK8zN\nZsa0cUD8RizDCnMZVpjL4SOLqezhAFFSkENFSQF/n7+aW194DzM48uASRg7N5/m3ttAa64Dq5LuA\ndJ5ApO8U+NJNb3P1JNLTAeI/Tz+aM8ZX0trewZI1dbzw1haef2sz81Zt2rXeX96IXx/Q1Bbj/94b\nn1S1oqSAUcMKOHhYAQXB9QNzFtV224dOJIscGAW+7KWnYZw9rQs9HyDycrI4oaacE2rK+c4nPkDN\nzAd3fbYwxwEDYEdzO9/7++Ju2y4tyuXgkgLe2bxzr/MGTW0xrrh/OXk5WRTkZpGfk01+ThYFudk8\n+8Zmrnt81a7P6AAhEqfAlz7bnwNE1y6gs8d08POl8Wv/Rg0r4C8XfIQNO5pZv72Z9V3+vt7DTdu3\nNbbxzb8tTGq/TW0xZvxjCfcurqV8SD7lQ3IpH5LPQUPyWLWhnj+/8F68mwkdICRzKfBlQPXUBXTp\nqUdw+MhiDh+594RTPc0HVDE0n1sv+DAtbR20tHfQ3Bajpb2Di/48P+G+22LOpoYWVq6vZ8vO1l5H\nGzW1xfjhP17l0dfWM6I4n5ElBYwozmdEST7La7fzyyff3K+hqDpRLelAgS8DqmsXENRTmUTruKeD\nxKxPHckRB5fstX5PJ5IrSwt54Nsn73rd2NrOloZWTr5mbsL9tsY6WLm+nmfrN7Ojub3XejW1xZh1\n91KW1m5neHE+w4vzgr/5LHhvK1c/9Hr8AJHkiWr9gpAwKPBlwHV2Ac2bN49vf2lKUutD308kd440\n6lSUl0NReU6vB4gnLomXr7ktFgxFbeHzv3k+4X6b2mLc/vL7NLbGEr4P8KdVu09U/8ecZTS3xRhV\nWsioYfGT1UMLcg/oJDXoICH7psCXQaE/TyTvKZkDREFuNtXlRVSXF/V6gHhu5ik0trazub6VzTtb\n2FzfwvS/LNi1zkH5ztaW+Inq+pZ2ZgZB3mlofg5NbTHaO7pPW97UFuM/H3iNUcMKKCnMpSQYGjsk\nLxsz00gmSYoCXzJSKg8QRXk5HHJQDoccVAR072L63KG7T1SPHlbAHd+YxPrtzazd3sy6uibWbW/m\nluffTbjfrTtb+debXuy2LMugpDCX+uZ2YgkOElfcv5wRQ/N3TYlRUpgzYAcInbdIPwp8EVJzgPjh\nqUdQVVZEVVlRt/Ufe21Dwl8QI4rzuf6c49jR1MaO5jZ2NLWzPXj+5xfeS7jvbY1tfOnm3VdD5+Vk\nMaI4n431zbTFEvyKuP81KkoK4hfXFe3+FXHv4rX7dYDodkDZjwvsJFwKfJEDcKAHiGROVPd0gPjR\np49k8uHDE37miRUbEx4kRg7N54ZzxrOpoYWNO5rZVN/CpvoW7l5Um3A7WxtbOff33X9F5GQZHe7s\n8QOCprYYl92zlIXvb6MwN5uC3GwK87IpzM3musdW7Sr/mp271+/tXsrqYgqfAl9kAOzPier9/QUB\nPR8kLvvUkUw67KC91n/pna09/oq44Zzj2N7U1u3x63lvJdxvY2uM+5aspak11uMw17+/vTtmauua\nOP1XzzGqpIBRpQWMHlbIqNIC3tjQwO+eeuuAhrrqAJE8Bb5IGtqfXxCd60Pfu5l+9OkjOTHBr4h7\nF6/t9UQ1QEeH09weo6k1xqdufIYNO+Izr36+JsZd78ZHJxXlZVNSkMObmxp45o1N7OxlRFPnUNfl\na7dzUHH8IrnhxfkcVJzHgne38bOHX9/vabkP9DxEphxUFPgiGSLVI5mysiw+1DUvh1mnHblr/Zqh\nvmv9K888Ztc+OmdeXbe9iVOvfybhfpvaYvzlxfdobut9Su7OdWfdvZTFq+soH5JHWVEupUV5lBXl\nUVqUyyvvbN2vg0RfTmyn64lqBb5IRIV5gEjmvEXXmVeTGeq6paGVzQ0tbGlo5cIerqZuaotx14I1\n1Lf0fqFc1/Vn/GMJt730PoV52RQF5yAKgxPVXQ9wnetfft9yOtzJyc4iN8vIyc4iJ9t4+e2t/OHZ\nd2iNddA8Oj1PVCvwRSQpB9LNlOx5i2SGuhaV51BdvvdQ1646DxBtsQ7qGtuoa2xlW2Mb2xpb+XqX\n6yG6aos5WVlQ19jKuu0xGlvj3VINPRw06pra+P4dS3qtz+9W7L7A7pqH0+dmQAp8EUm5/u5iys3O\nYsTQfEYMzd/1fm8HidnTJ+21vMc5nEry+fv0SbR3dNAWc9pjTltHB2f9evcV2B8sc5ZsjV9gt3Z7\nMzc/8zafP76KsiF5yfxzhEaBLyJpIcwuJkh+yo19rT/rtCOpGT5kr/W7HlD+ubKDJVvjF9jlZhs/\neXAF1zy8klOPPphzPlzNpLEH7boAbiBPCivwRWRQCnskU3/96rjqrGM4YtRQZr+8mrsXruG+JWsZ\nM3wIR48u4bHXNuz3SKO+UOCLSGQc6HmIZNeFnk9UX/65DzLztCP4n6XrmP3yau5/dd1e29jXxWl9\nlRXKVkVEIuiM8ZU8N/MUjqnfCYYrAAAFsklEQVQcxnMzT9kruAtysznr+Cru+Mbe5ww6rU1w3qC/\nKPBFRFKgsrQw4fLRPSzvDwp8EZEUmDFtHIW52d2W9XYSuT+oD19EJAUOZKRRXynwRURSZH9PIveV\nunRERCJCgS8iEhEKfBGRiAg18M3sVDNbaWZvmtnMMPclIiK9Cy3wzSwb+BVwGnAUcK6ZHRXW/kRE\npHdhtvA/DLzp7m+7eyswGzg9xP2JiEgvwhyWWQms7vJ6DfCRPVcys+nA9OBlg5mtDJ4PBzaHWL50\nFLU6R62+oDpHxUDW+dBkV0z5OHx3vwm4ac/lZjbf3SemoEgpE7U6R62+oDpHRbrWOcwunVqgusvr\nqmCZiIikQJiB/wrwATMbY2Z5wDnAfSHuT0REehFal467t5vZxcAjQDbwR3dfvh+b2KubJwKiVueo\n1RdU56hIyzqbu6e6DCIiMgB0pa2ISEQo8EVEIiLtAj+K0zGY2btmttTMFpvZ/FSXJwxm9kcz22hm\ny7osKzezx8zsjeBvWSrL2N96qPPlZlYbfNeLzexTqSxjfzKzajOba2avmdlyM/tusDxjv+de6pyW\n33Na9eEH0zGsAv6F+IVarwDnuvtrKS1YyMzsXWCiu2fsxSlm9jGgAfizux8dLLsG2OruVwcH9zJ3\nvzSV5exPPdT5cqDB3f87lWULg5mNAka5+0IzGwosAM4AzidDv+de6vxF0vB7TrcWvqZjyFDu/jSw\ndY/FpwO3Bs9vJf4/Ssbooc4Zy93XufvC4Hk9sIL4FfcZ+z33Uue0lG6Bn2g6hrT9x+tHDjxqZguC\nqSaiosLd1wXP1wMVqSzMALrYzF4NunwypnujKzOrAcYDLxGR73mPOkMafs/pFvhRdZK7H098ZtFv\nBV0BkeLxvsX06V8Mz2+Aw4DjgHXAz1NbnP5nZsXAXcD33H1H1/cy9XtOUOe0/J7TLfAjOR2Du9cG\nfzcC9xDv2oqCDUEfaGdf6MYUlyd07r7B3WPu3gH8ngz7rs0sl3jw/c3d7w4WZ/T3nKjO6fo9p1vg\nR246BjMbEpzswcyGAJ8ElvX+qYxxH3Be8Pw84N4UlmVAdAZf4Ewy6Ls2MwP+AKxw9190eStjv+ee\n6pyu33NajdIBCIYvXc/u6Rh+muIihcrMxhJv1UN8qovbMrHOZnY7MIX4tLEbgB8Dc4A7gEOA94Av\nunvGnOTsoc5TiP/Md+Bd4Otd+rcHNTM7CXgGWAp0BIsvI96nnZHfcy91Ppc0/J7TLvBFRCQc6dal\nIyIiIVHgi4hEhAJfRCQiFPgiIhGhwBcRiQgFvmQ8M4t1mbVwcXAJ/P5u43wzG93/pRMZOKHd4lAk\njTS5+3F93Mb5xC+eWZvsB8ws291jfdyvSL9RC18iycxqzOwZM1sYPE7s8t6lwf0JlpjZ1WZ2NjAR\n+FvwC6HQzD5hZouC9f5oZvnBZ981s5+Z2ULgC2b2nWCu9FfNbHaKqisCqIUv0VBoZouD5++4+5nE\n53P5F3dvNrMPALcDE83sNOLT+X7E3RvNrNzdt5rZxcAP3H2+mRUAtwCfcPdVZvZn4N+JXyEOsCWY\nDA8zWwuMcfcWMysdsBqLJKAWvkRBk7sfFzzODJblAr83s6XAncBRwfJ/Bv7k7o0APUwBMI74gWNV\n8PpWoOsMp3/v8vxV4r8Mvgy09091RA6MAl+i6n8Tn9/mQ8S7a/L6cds7uzz/NPAr4HjgFTPTr2pJ\nGQW+RNUwYF0wfe1XiE/WB/AY8DUzK4L4/ViD5fXA0OD5SqDGzA4PXn8FeGrPHZhZFlDt7nOBS4N9\nFodQF5GkKPAlqn4NnGdmS4AjCFrl7v4w8el85wf9/j8I1r8F+G2wzICvAXcGXUIdwG8T7CMb+Guw\nziLgRnevC69KIr3TbJkiIhGhFr6ISEQo8EVEIkKBLyISEQp8EZGIUOCLiESEAl9EJCIU+CIiEfH/\nAfTzDS29EmJJAAAAAElFTkSuQmCC\n",
            "text/plain": [
              "<Figure size 432x288 with 1 Axes>"
            ]
          },
          "metadata": {
            "tags": []
          }
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "9AmVXMkJXTdi",
        "colab_type": "text"
      },
      "source": [
        "The scree plot method draws a straight line for each factor and its eigenvalues. Number eigenvalues greater than one considered as the number of factors.\n",
        "\n",
        "Here, you can see again 6-factors eigenvalues are greater than one. It means we need to choose only 6 factors (or unobserved variables).\n",
        "\n",
        "However something we can additionally, see is that after the first 5, there really isnt a diffence in the eigenvalues. So really only the first two are significant. Therefore we will only choose **5 factors**."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "rP0mIgpSyt6j",
        "colab_type": "text"
      },
      "source": [
        "## Running factor analysis\n",
        "\n"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "es4vNDC1XYdW",
        "colab_type": "code",
        "outputId": "c5735c87-1ad2-4027-ead4-1dfeed33b5a4",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 855
        }
      },
      "source": [
        "# Create factor analysis object and perform factor analysis\n",
        "fa = FactorAnalyzer()\n",
        "numFactors = 5 # this will vary based on what you saw above\n",
        "fa.analyze(df, numFactors, rotation=\"varimax\")\n",
        "fa.loadings"
      ],
      "execution_count": 10,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>Factor1</th>\n",
              "      <th>Factor2</th>\n",
              "      <th>Factor3</th>\n",
              "      <th>Factor4</th>\n",
              "      <th>Factor5</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>Unnamed: 0</th>\n",
              "      <td>-0.061703</td>\n",
              "      <td>-0.019246</td>\n",
              "      <td>0.034865</td>\n",
              "      <td>0.014345</td>\n",
              "      <td>-0.018678</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>A1</th>\n",
              "      <td>0.030705</td>\n",
              "      <td>0.106455</td>\n",
              "      <td>0.027567</td>\n",
              "      <td>-0.074133</td>\n",
              "      <td>-0.429612</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>A2</th>\n",
              "      <td>0.227127</td>\n",
              "      <td>0.028693</td>\n",
              "      <td>0.141159</td>\n",
              "      <td>0.064117</td>\n",
              "      <td>0.621801</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>A3</th>\n",
              "      <td>0.329927</td>\n",
              "      <td>0.005335</td>\n",
              "      <td>0.115928</td>\n",
              "      <td>0.061647</td>\n",
              "      <td>0.642856</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>A4</th>\n",
              "      <td>0.209217</td>\n",
              "      <td>-0.069443</td>\n",
              "      <td>0.235418</td>\n",
              "      <td>-0.108647</td>\n",
              "      <td>0.431241</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>A5</th>\n",
              "      <td>0.397690</td>\n",
              "      <td>-0.129002</td>\n",
              "      <td>0.097901</td>\n",
              "      <td>0.075363</td>\n",
              "      <td>0.528159</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>C1</th>\n",
              "      <td>0.048297</td>\n",
              "      <td>0.009548</td>\n",
              "      <td>0.548276</td>\n",
              "      <td>0.212169</td>\n",
              "      <td>0.041194</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>C2</th>\n",
              "      <td>0.014459</td>\n",
              "      <td>0.089975</td>\n",
              "      <td>0.650304</td>\n",
              "      <td>0.116582</td>\n",
              "      <td>0.105693</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>C3</th>\n",
              "      <td>0.010825</td>\n",
              "      <td>-0.030243</td>\n",
              "      <td>0.555781</td>\n",
              "      <td>-0.004812</td>\n",
              "      <td>0.114165</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>C4</th>\n",
              "      <td>-0.039326</td>\n",
              "      <td>0.240794</td>\n",
              "      <td>-0.633576</td>\n",
              "      <td>-0.109695</td>\n",
              "      <td>-0.041462</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>C5</th>\n",
              "      <td>-0.154179</td>\n",
              "      <td>0.294330</td>\n",
              "      <td>-0.566991</td>\n",
              "      <td>0.031264</td>\n",
              "      <td>-0.047858</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>E1</th>\n",
              "      <td>-0.576460</td>\n",
              "      <td>0.057066</td>\n",
              "      <td>0.017182</td>\n",
              "      <td>-0.073218</td>\n",
              "      <td>-0.089660</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>E2</th>\n",
              "      <td>-0.671561</td>\n",
              "      <td>0.261661</td>\n",
              "      <td>-0.121490</td>\n",
              "      <td>-0.059680</td>\n",
              "      <td>-0.096788</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>E3</th>\n",
              "      <td>0.533056</td>\n",
              "      <td>0.012417</td>\n",
              "      <td>0.097624</td>\n",
              "      <td>0.293883</td>\n",
              "      <td>0.245741</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>E4</th>\n",
              "      <td>0.648750</td>\n",
              "      <td>-0.131026</td>\n",
              "      <td>0.120495</td>\n",
              "      <td>-0.056985</td>\n",
              "      <td>0.290069</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>E5</th>\n",
              "      <td>0.492534</td>\n",
              "      <td>0.024327</td>\n",
              "      <td>0.326639</td>\n",
              "      <td>0.226538</td>\n",
              "      <td>0.079579</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>N1</th>\n",
              "      <td>0.097680</td>\n",
              "      <td>0.782726</td>\n",
              "      <td>-0.042388</td>\n",
              "      <td>-0.083471</td>\n",
              "      <td>-0.225060</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>N2</th>\n",
              "      <td>0.044935</td>\n",
              "      <td>0.752420</td>\n",
              "      <td>-0.029547</td>\n",
              "      <td>-0.010945</td>\n",
              "      <td>-0.200539</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>N3</th>\n",
              "      <td>-0.041066</td>\n",
              "      <td>0.732571</td>\n",
              "      <td>-0.068349</td>\n",
              "      <td>-0.007284</td>\n",
              "      <td>-0.031849</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>N4</th>\n",
              "      <td>-0.326102</td>\n",
              "      <td>0.599635</td>\n",
              "      <td>-0.188999</td>\n",
              "      <td>0.064659</td>\n",
              "      <td>0.010191</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>N5</th>\n",
              "      <td>-0.139326</td>\n",
              "      <td>0.542043</td>\n",
              "      <td>-0.042065</td>\n",
              "      <td>-0.155653</td>\n",
              "      <td>0.100229</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>O1</th>\n",
              "      <td>0.196463</td>\n",
              "      <td>-0.006094</td>\n",
              "      <td>0.120863</td>\n",
              "      <td>0.510642</td>\n",
              "      <td>0.059573</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>O2</th>\n",
              "      <td>0.026762</td>\n",
              "      <td>0.174735</td>\n",
              "      <td>-0.099129</td>\n",
              "      <td>-0.469638</td>\n",
              "      <td>0.077368</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>O3</th>\n",
              "      <td>0.296243</td>\n",
              "      <td>0.021106</td>\n",
              "      <td>0.084710</td>\n",
              "      <td>0.603572</td>\n",
              "      <td>0.122369</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>O4</th>\n",
              "      <td>-0.189289</td>\n",
              "      <td>0.227826</td>\n",
              "      <td>-0.029353</td>\n",
              "      <td>0.362255</td>\n",
              "      <td>0.160787</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>O5</th>\n",
              "      <td>0.011590</td>\n",
              "      <td>0.083619</td>\n",
              "      <td>-0.061357</td>\n",
              "      <td>-0.533401</td>\n",
              "      <td>-0.013974</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "             Factor1   Factor2   Factor3   Factor4   Factor5\n",
              "Unnamed: 0 -0.061703 -0.019246  0.034865  0.014345 -0.018678\n",
              "A1          0.030705  0.106455  0.027567 -0.074133 -0.429612\n",
              "A2          0.227127  0.028693  0.141159  0.064117  0.621801\n",
              "A3          0.329927  0.005335  0.115928  0.061647  0.642856\n",
              "A4          0.209217 -0.069443  0.235418 -0.108647  0.431241\n",
              "A5          0.397690 -0.129002  0.097901  0.075363  0.528159\n",
              "C1          0.048297  0.009548  0.548276  0.212169  0.041194\n",
              "C2          0.014459  0.089975  0.650304  0.116582  0.105693\n",
              "C3          0.010825 -0.030243  0.555781 -0.004812  0.114165\n",
              "C4         -0.039326  0.240794 -0.633576 -0.109695 -0.041462\n",
              "C5         -0.154179  0.294330 -0.566991  0.031264 -0.047858\n",
              "E1         -0.576460  0.057066  0.017182 -0.073218 -0.089660\n",
              "E2         -0.671561  0.261661 -0.121490 -0.059680 -0.096788\n",
              "E3          0.533056  0.012417  0.097624  0.293883  0.245741\n",
              "E4          0.648750 -0.131026  0.120495 -0.056985  0.290069\n",
              "E5          0.492534  0.024327  0.326639  0.226538  0.079579\n",
              "N1          0.097680  0.782726 -0.042388 -0.083471 -0.225060\n",
              "N2          0.044935  0.752420 -0.029547 -0.010945 -0.200539\n",
              "N3         -0.041066  0.732571 -0.068349 -0.007284 -0.031849\n",
              "N4         -0.326102  0.599635 -0.188999  0.064659  0.010191\n",
              "N5         -0.139326  0.542043 -0.042065 -0.155653  0.100229\n",
              "O1          0.196463 -0.006094  0.120863  0.510642  0.059573\n",
              "O2          0.026762  0.174735 -0.099129 -0.469638  0.077368\n",
              "O3          0.296243  0.021106  0.084710  0.603572  0.122369\n",
              "O4         -0.189289  0.227826 -0.029353  0.362255  0.160787\n",
              "O5          0.011590  0.083619 -0.061357 -0.533401 -0.013974"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 10
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "y1ylue-xy25x",
        "colab_type": "text"
      },
      "source": [
        "## Translating this into something we can understand a bit better"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "jXtE5F5VaLvW",
        "colab_type": "code",
        "outputId": "5ebab41d-9386-42c6-de90-0ed765640d62",
        "cellView": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 122
        }
      },
      "source": [
        "\n",
        "L = np.array(fa.loadings)\n",
        "headings = list( fa.loadings.transpose().keys() )\n",
        "factor_threshold = 0.25\n",
        "for i, factor in enumerate(L.transpose()):\n",
        "  descending = np.argsort(np.abs(factor))[::-1]\n",
        "  contributions = [(np.round(factor[x],2),headings[x]) for x in descending if np.abs(factor[x])>factor_threshold]\n",
        "  print('Factor %d:'%(i+1),contributions)"
      ],
      "execution_count": 13,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Factor 1: [(-0.67, 'E2'), (0.65, 'E4'), (-0.58, 'E1'), (0.53, 'E3'), (0.49, 'E5'), (0.4, 'A5'), (0.33, 'A3'), (-0.33, 'N4'), (0.3, 'O3')]\n",
            "Factor 2: [(0.78, 'N1'), (0.75, 'N2'), (0.73, 'N3'), (0.6, 'N4'), (0.54, 'N5'), (0.29, 'C5'), (0.26, 'E2')]\n",
            "Factor 3: [(0.65, 'C2'), (-0.63, 'C4'), (-0.57, 'C5'), (0.56, 'C3'), (0.55, 'C1'), (0.33, 'E5')]\n",
            "Factor 4: [(0.6, 'O3'), (-0.53, 'O5'), (0.51, 'O1'), (-0.47, 'O2'), (0.36, 'O4'), (0.29, 'E3')]\n",
            "Factor 5: [(0.64, 'A3'), (0.62, 'A2'), (0.53, 'A5'), (0.43, 'A4'), (-0.43, 'A1'), (0.29, 'E4')]\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "4LMjFfoJxaDZ",
        "colab_type": "text"
      },
      "source": [
        "**So what does this mean?**"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "U2ubfqwlXkym",
        "colab_type": "text"
      },
      "source": [
        "## Solution\n",
        "\n",
        "\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "hMuZ2xQJxXdO",
        "colab_type": "text"
      },
      "source": [
        "Factor 1 is mostly influenced by the questions about extrovertedness (E); some parts of agreeableness, openness, and nueroticism, influence this, but it is mostly E. These were the original E questions.\n",
        "\n",
        "Factor 2 is mostly influenced by neuroticism (N), but smoe parts of extrovertedness and conscientiousness play a role. These were the original N questions.\n",
        "\n",
        "Factor 3 is mostly influenced by conscientiousness, but extrovertedness can play a role.\n",
        "These were the original C questions.\n",
        "\n",
        "Factor 4 is mostly influenced by openness but extrovertedness plays a role.\n",
        "These were the original O questions.\n",
        "\n",
        "Factor 5 is mostly influenced by agreeableness but extrovertedness plays a role.\n",
        "These were the original A questions.\n",
        "\n",
        "In summary, we were able to extract the original groupings however it was interesting to note the role that E plays in all of the questions. This could suggest that there is some bias or systematic error at play. "
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "RgwoZseOxQ_n",
        "colab_type": "text"
      },
      "source": [
        "# Computing the variance"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "bxzTgYfzRvsp",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        ""
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "wGC0sDVcXthY",
        "colab_type": "code",
        "cellView": "both",
        "outputId": "b8b24f66-0a6b-485d-83b6-f3308611ddc0",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 142
        }
      },
      "source": [
        "# Get variance of each factors\n",
        "fa.get_factor_variance()"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>Factor1</th>\n",
              "      <th>Factor2</th>\n",
              "      <th>Factor3</th>\n",
              "      <th>Factor4</th>\n",
              "      <th>Factor5</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>SS Loadings</th>\n",
              "      <td>2.428049</td>\n",
              "      <td>2.736109</td>\n",
              "      <td>2.082504</td>\n",
              "      <td>1.549502</td>\n",
              "      <td>1.800505</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>Proportion Var</th>\n",
              "      <td>0.093387</td>\n",
              "      <td>0.105235</td>\n",
              "      <td>0.080096</td>\n",
              "      <td>0.059596</td>\n",
              "      <td>0.069250</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>Cumulative Var</th>\n",
              "      <td>0.093387</td>\n",
              "      <td>0.198621</td>\n",
              "      <td>0.278718</td>\n",
              "      <td>0.338314</td>\n",
              "      <td>0.407564</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "                 Factor1   Factor2   Factor3   Factor4   Factor5\n",
              "SS Loadings     2.428049  2.736109  2.082504  1.549502  1.800505\n",
              "Proportion Var  0.093387  0.105235  0.080096  0.059596  0.069250\n",
              "Cumulative Var  0.093387  0.198621  0.278718  0.338314  0.407564"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 10
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "0Qn7XAVxXyFS",
        "colab_type": "text"
      },
      "source": [
        "Total 41% cumulative Variance explained by the 2 factors."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "AenH31yxX3E5",
        "colab_type": "text"
      },
      "source": [
        "**Pros and Cons of Factor Analysis**\n",
        "\n",
        "Factor analysis explores large dataset and finds interlinked associations. It reduces the observed variables into a few unobserved variables or identifies the groups of inter-related variables, which help the market researchers to compress the market situations and find the hidden relationship among consumer taste, preference, and cultural influence. Also, It helps in improve questionnaire in for future surveys. Factors make for more natural data interpretation.\n",
        "\n",
        "Results of factor analysis are controversial. Its interpretations can be debatable because more than one interpretation can be made of the same data factors. After factor identification and naming of factors requires domain knowledge."
      ]
    }
  ]
}