Sign Up Now!

Sign up and get personalized intelligence briefing delivered daily.


Sign Up

Articles related to "research"


Lookahead Optimizer: k steps forward, 1 step back

  • Michael Zhang is a PhD student at the University of Toronto and Vector Institute, supervised by Jimmy Ba. His current research focus is on optimization and deep learning.
  • The vast majority of successful deep neural networks are trained using variants of stochastic gradient descent (SGD) algorithms.
  • Recent attempts to improve SGD can be broadly categorized into two approaches: (1) adaptive learning rate schemes, such as AdaGrad and Adam, and (2) accelerated schemes, such as heavy-ball and Nesterov momentum.
  • I will discuss how neural network algorithms can be analyzed and show that Lookahead improves the learning stability and lowers the variance of its inner optimizer with negligible computation and memory cost.
  • I will then present empirical results demonstrating Lookahead can significantly improve the performance of SGD and Adam, even with their default hyperparameter settings on ImageNet, CIFAR-10/100, neural machine translation, and Penn Treebank.

save | comments | report | share on


Breaking down Data Scientist Roles

  • While not the flashiest job, these Data Scientists have a strong footing in the business-product world and the opportunity to inform important decisions for the company.
  • Companies with more established data teams or companies that incorporate Machine Learning as a part of their core product will hire scientists for the sole purpose of maintaining, improving and building new models and AI systems.
  • Data generalists are typically hired to provide general support to other company functions by building dashboards, maintaining the data warehouse and occasionally building models to improve operational processes.
  • In addition to these specialized skills, here’s a common check list for all aspiring Data Scientists irregardless of which role they want to pursue.
  • In addition to sharing your projects on GitHub/personal site, you can also stand out by detailing your data adventures through a blog (such as Medium!) or by cultivating a presence on online communities such as Kaggle or Quora.

save | comments | report | share on


NASA-SpaceX launches will boost science research on the space station

  • Now, NASA's Commercial Crew program can expand the amount of astronauts on the space station — which means that more science, and even new types of experiments, can happen in the unique microgravity environment.
  • This means that astronauts could either double up on experiments by working together or split into shift teams where they stagger when the astronauts are awake and asleep, so crews could hand off an experiment that requires 13 hours rather than six — especially an issue in life sciences, cell biology and rodent research.
  • This will allow NASA and their Human Research Program to better study the effects of space on human health and develop countermeasures to mitigate them — especially as they prepare to send astronauts back to the moon and eventually on to Mars.
  • Non-NASA research is managed by the ISS National Laboratory, which utilizes the space station's unique microgravity environment to send up experiments from commercial businesses, academic institutions and government agencies that can benefit Earth.

save | comments | report | share on


What Is The Insurrection Act?

  • Be it enacted by the Senate and House of Representatives of the United States of America in Congress assembled, That in all cases of insurrection, or obstruction to the laws, either of the United States, or of any individual state or territory, where it is lawful for the President of the United States to call forth the militia for the purpose of suppressing such insurrection, or of causing the laws to be duly executed, it shall be lawful for him to employ, for the same purposes, such part of the land or naval force of the United States, as shall be judged necessary, having first observed all the pre-requisites of the law in that respect.
  • If the situation does not resolve itself, the President may issue an executive order to send in troops," according to a 2006 report by the Congressional Research Service.

save | comments | report | share on


The Dream of a Lifetime (2005)

  • Then, as Markoff relates, in February 1960, five years before Gordon Moore published an article in Electronics magazine whose assertions would become known as “Moore’s Law,” Doug Engelbart came to the same conclusion that Moore would: that a relentless and inevitable increase in computing capacity would result from the continuous shrinking of the transistor.
  • The 1960s: Drugs and ProtestDormouse describes how political, social, and cultural forces came together to shape the early personal-computer industry on the West Coast: Engelbart and his colleagues were part of a community that included early experimenters with LSD and leaders of the antiwar movement.
  • Similarly powerful systems were built on Digital Equipment PDP-10s at MIT, Stanford (SAIL), and Carnegie Mellon University, often, like Engelbart’s NLS, with support from federal research funds.

save | comments | report | share on


Can Trump legally deploy US troops to US cities?

  • One section of the law suggests that states must first request help, but other portions of the Insurrection Act do not require a governor or state legislature's okay, such as when the President determines the situation in a state makes it impossible to enforce US laws or when citizens' rights are abridged.
  • There are examples of presidents using troops over the objections of governors, as Dwight Eisenhower (and later John F.
  • In particular, Eisenhower invoked the Insurrection Act when he federalized the Arkansas National Guard and then sent the 101st Airborne Division into Little Rock to integrate the schools.
  • That use may have been on the mind of Sen. Tom Cotton, the Arkansas Republican, when he suggested on Twitter that Trump employ the 101st Airborne Division.

save | comments | report | share on


SARS-CoV-2 looks like a hybrid of viruses from two different species

  • Now, a US-based research team has done a detailed analysis of a large collection of viral genomes, and it finds that evolution pieced together the virus from multiple parts—most from bats, but with a key contribution from pangolins.
  • So, for the new analysis, the research team started with a collection of 43 different coronaviruses from a variety of species, including humans, bats, and the pangolin sequences known to be similar to SARS-CoV-2.
  • But there was a notable exception to this mixing of bat viruses: the spike protein that sits on the virus' surface and latches on to human cells.
  • Here, the researchers found exactly what the earlier studies had suggested: a key stretch of the spike protein, the one that determines which proteins on human cells it interacts with, came from a pangolin version of the virus through recombination.

save | comments | report | share on


List of coronavirus treatments being tested in clinical trials - Business Insider

  • On June 1, Gilead said that remdesivir helped hospitalized patients with more moderate forms of COVID-19 recover more quickly when receiving the treatment for 5 days.
  • A massive study published May 22 found that the treatments didn't appear to help patients hospitalized with the novel coronavirus and instead were associated with heart complications and an increased risk of death.
  • Pharma company Pfizer in April published a review of these antiviral characteristics seen in laboratory research and clinical tests with the intent of facilitating further research of how azithromycin works in COVID-19.
  • In May, Russia approved the treatment for use in fighting the novel coronavirus, with officials saying preliminary tests showed that hospitalized patients who received the drug recovered more quickly than those who didn't.The full results of that study have not been released as of yet.

save | comments | report | share on


List of coronavirus treatments being tested in clinical trials - Business Insider

  • On June 1, Gilead said that remdesivir helped hospitalized patients with more moderate forms of COVID-19 recover more quickly when receiving the treatment for 5 days.
  • A massive study published May 22 found that the treatments didn't appear to help patients hospitalized with the novel coronavirus and instead were associated with heart complications and an increased risk of death.
  • Pharma company Pfizer in April published a review of these antiviral characteristics seen in laboratory research and clinical tests with the intent of facilitating further research of how azithromycin works in COVID-19.
  • In May, Russia approved the treatment for use in fighting the novel coronavirus, with officials saying preliminary tests showed that hospitalized patients who received the drug recovered more quickly than those who didn't.The full results of that study have not been released as of yet.

save | comments | report | share on


Could dairy protect against diabetes and hypertension?

  • A study including almost 150,000 participants has found that a higher intake of dairy products, particularly whole fat varieties, is linked with a lower risk of high blood pressure and diabetes.
  • Now, a large international study of data from almost 150,000 people has concluded that a higher intake of dairy, especially whole fat varieties, is associated with a lower risk of diabetes and high blood pressure.
  • While butter intake was also associated with a lower risk of metabolic syndrome, consumption was very low, on average 3 grams per day, and the available data were limited.
  • If their conclusions are confirmed, the researchers say, increasing the consumption of dairy could prove to be a “feasible and low-cost approach” to reducing rates of metabolic syndrome, high blood pressure, and diabetes worldwide.

save | comments | report | share on