learning propress

What's going on?

• Machine learning
• Feature engineering
• Helpers
• Hadoop
• Kafka
• Flume
• PHP

Machine learning [leaderboard]:

• Ensemble Model 2018.06 [ipynb]

• Ensemble XGB 2018.06 [ipynb]

Feature engineering [leaderboard]:

• Feature selection 2018.06 [ipynb]

Helpers [py]:

mixed check_missing_values(dataframe data, int head)

  print(missing values)

str timer(str title)

  with timer('xxx'):
    pass

mixed fix_missing_value(dataframe df, str col, str boosting_type='mean')

  return new_dataframe

mixed one_hot_encoder(dataframe df, boolean nan_as_category)

  return new_dataframe, new_columns

mixed freq_encoding(dataframe df, list cols, boolean drop=False)

  return new_dataframe

mixed binary_encoding(dataframe train_df, dataframe test_df, str col)

  return new_train_df, new_test_df

mixed _corr_matrix(dataframe df, float threshold=0.9)

  return drop_columns