Sign Up Now!

Sign up and get personalized intelligence briefing delivered daily.


Sign Up

Articles related to "learn"


Political Data Science: A tale of tweets

  • The current political situation in Scotland after the Brexit vote, and most recently, Boris Johnson’s win in the winter General Election of 2019, is very heated.
  • I then performed a systematic comparison with a Deep Learning Recurrent Neural Network (RNN) known as Long-Short-Term-Memory (LSTM) Network.
  • With Grid Search you set up a grid of hyperparameter values and for each combination, train a model and score on the validation data.
  • I passed the combined hyperparameters to the GridsearchCV object for each classifier and 10 folds for the cross validation which means that for every parameter combination, the grid ran 10 different iterations with a different test set every time (this took a while…).
  • And if we want a neural network to understand our tweets, we need one that can learn from what it reads and build on it.

save | comments | report | share on


Is PyTorch Catching TensorFlow?

  • PyTorch can now be run more easily on Google Cloud’s Tensor Processing Units (TPUs) — the fastest way to train complex deep learning models.
  • TensorFlow still has more bells and whistles for deep learning in production and on the edge than PyTorch does, but PyTorch is getting closer to feature parity.
  • PyTorch and TensorFlow are the two games in town if you want to learn a popular deep learning framework.
  • In this article, I’m going to focus on the four metrics that I think matter most: job listings, research use, online search results, and self-reported use.
  • I used Google Trends to find the relative number of searches for PyTorch (Software) and TensorFlow (Computer application) in the USA from January 26, 2017 to January 26, 2020.
  • PyTorch has taken the lead in usage in research papers at top conferences and almost closed the gap in Google search results.

save | comments | report | share on


Political Data Science: A tale of tweets

  • The current political situation in Scotland after the Brexit vote, and most recently, Boris Johnson’s win in the winter General Election of 2019, is very heated.
  • I then performed a systematic comparison with a Deep Learning Recurrent Neural Network (RNN) known as Long-Short-Term-Memory (LSTM) Network.
  • With Grid Search you set up a grid of hyperparameter values and for each combination, train a model and score on the validation data.
  • I passed the combined hyperparameters to the GridsearchCV object for each classifier and 10 folds for the cross validation which means that for every parameter combination, the grid ran 10 different iterations with a different test set every time (this took a while…).
  • And if we want a neural network to understand our tweets, we need one that can learn from what it reads and build on it.

save | comments | report | share on


Is PyTorch Catching TensorFlow?

  • PyTorch can now be run more easily on Google Cloud’s Tensor Processing Units (TPUs) — the fastest way to train complex deep learning models.
  • TensorFlow still has more bells and whistles for deep learning in production and on the edge than PyTorch does, but PyTorch is getting closer to feature parity.
  • PyTorch and TensorFlow are the two games in town if you want to learn a popular deep learning framework.
  • In this article, I’m going to focus on the four metrics that I think matter most: job listings, research use, online search results, and self-reported use.
  • I used Google Trends to find the relative number of searches for PyTorch (Software) and TensorFlow (Computer application) in the USA from January 26, 2017 to January 26, 2020.
  • PyTorch has taken the lead in usage in research papers at top conferences and almost closed the gap in Google search results.

save | comments | report | share on


Political Data Science: A tale of tweets

  • The current political situation in Scotland after the Brexit vote, and most recently, Boris Johnson’s win in the winter General Election of 2019, is very heated.
  • I then performed a systematic comparison with a Deep Learning Recurrent Neural Network (RNN) known as Long-Short-Term-Memory (LSTM) Network.
  • With Grid Search you set up a grid of hyperparameter values and for each combination, train a model and score on the validation data.
  • I passed the combined hyperparameters to the GridsearchCV object for each classifier and 10 folds for the cross validation which means that for every parameter combination, the grid ran 10 different iterations with a different test set every time (this took a while…).
  • And if we want a neural network to understand our tweets, we need one that can learn from what it reads and build on it.

save | comments | report | share on


Political Data Science: A tale of tweets

  • The current political situation in Scotland after the Brexit vote, and most recently, Boris Johnson’s win in the winter General Election of 2019, is very heated.
  • I then performed a systematic comparison with a Deep Learning Recurrent Neural Network (RNN) known as Long-Short-Term-Memory (LSTM) Network.
  • With Grid Search you set up a grid of hyperparameter values and for each combination, train a model and score on the validation data.
  • I passed the combined hyperparameters to the GridsearchCV object for each classifier and 10 folds for the cross validation which means that for every parameter combination, the grid ran 10 different iterations with a different test set every time (this took a while…).
  • And if we want a neural network to understand our tweets, we need one that can learn from what it reads and build on it.

save | comments | report | share on


The iPad is still finding its place ten years in

  • The video series Processor that is a complement to this newsletter is in some ways an ongoing meditation on the question Apple famously asked in one iPad commercial: What’s a computer?
  • I don’t think any user interface — whether it’s a computer or a bicycle — is the sort of thing that humans just innately understand.
  • The video conferencing software we use, Zoom, isn’t allowed to keep the camera on the iPad active when it’s not the frontmost app.
  • I think it’s the tensions between the limiting and liberating parts of the iPad — both of which still feel new, even now — that make it worth paying attention to.
  • If Apple won’t allow a third party to maintain an archive of its history, I hope it’s doing something to retain and maintain these videos itself.

save | comments | report | share on


Gradient Boosting from Almost Scratch

  • I said gradient boosting from almost scratch; I use scikit-learn’s models as my weak learners and use numpy for for certain mathematical functions and for its array structure.
  • In addition, I am using their ridge regression model whose loss function is the sum of the squared errors + the l2 norm of the coefficients multiplied by a penalty coefficient.
  • Before we make predictions, it is helpful to see how the training mean square error evolves with more boosting iterations, so we can try and fit a well calibrated model.
  • When using the ridge regression model, the training mean square error plunges until 20 rounds and it really levels off after 30.
  • At 100 iterations, our boosted trees model is decent, but it performs worse in the testing data set the farther from the mean of the target variable.

save | comments | report | share on


Part 14: Permutations, Combinations, & Subsets

  • This post is longer than usual & very heavy on problem solving, instead of the usual "learning about a DS/Algo, then writing an example".
  • I don't expect to get back into this style of post again until I have finished the remaining curriculum.
  • It just happens that the best way to really learn this material was to solve some problems after covering theory.
  • I encourage you to stick with each problem even if it doesn't click the first time around.
  • As always, if you found any errors in this post please let me know!

save | comments | report | share on


Gradient Boosting from Almost Scratch

  • I said gradient boosting from almost scratch; I use scikit-learn’s models as my weak learners and use numpy for for certain mathematical functions and for its array structure.
  • In addition, I am using their ridge regression model whose loss function is the sum of the squared errors + the l2 norm of the coefficients multiplied by a penalty coefficient.
  • Before we make predictions, it is helpful to see how the training mean square error evolves with more boosting iterations, so we can try and fit a well calibrated model.
  • When using the ridge regression model, the training mean square error plunges until 20 rounds and it really levels off after 30.
  • At 100 iterations, our boosted trees model is decent, but it performs worse in the testing data set the farther from the mean of the target variable.

save | comments | report | share on