AI News, Kaixhin/nninit

Kaixhin/nninit

Parameter initialisation schemes for Torch7 neural network modules.

Supported modules: Readme contents: nninit adds an init method to nn.Module, with the following API: The accessor argument is used to extract the tensor to be initialised from the module.

The initialiser argument is a function that takes the module, tensor, and further options;

it adjusts the tensor and returns the module, allowing init calls to be chained.

For example: The tensor is first accessed as a property of the module from the first element, and a subtensor is then extracted using Torch's indexing operator applied to the second element.

The initialisation scheme typically includes the gain for ReLU units, which has to be manually specified in nninit.kaiming with the option {gain = 'relu'}. Also

Sets (1 - sparsity) percent of the tensor to 0, where sparsity is between 0 and 1.

initialisation scheme described in the paper includes the gain for ReLU units, which has to be manually specified with the option {gain = 'relu'}. The

If the gain must be calculated from additional parameters, gain must be passed as table with the string as the first element as well as named parameters.

For example: To develop nninit/use it to test new initialisation schemes, git clone/download this repo and use luarocks make rocks/nninit-scm-1.rockspec to install nninit locally.

Lecture 9: Machine Translation and Advanced Recurrent LSTMs and GRUs

Lecture 9 recaps the most important concepts and equations covered so far followed by machine translation and fancy RNN models tackling MT. Key phrases: ...

Microsoft Build 2018 // Vision Keynote

CEO Satya Nadella takes the stage at Microsoft Build, our annual developer conference, at 8:30AM PT Monday, May 7. Join us to learn what's next for ...

Technology Keynote: Microsoft Azure : Build 2018

Create a Free Account (Azure):

RailsConf 2017: Predicting Titanic Survivors with Machine Learning by Ju Liu

RailsConf 2017: Predicting Titanic Survivors with Machine Learning by Ju Liu What's a better way to understand machine learning than a practical example?

TensorFlow Dev Summit 2018 - Livestream

TensorFlow Dev Summit 2018 All Sessions playlist → Live from Mountain View, CA! Join the TensorFlow team as they host the second ..

Day 3 Keynote: Made Here Together (Cloud Next '18)

Understand from our leading developer pioneers why and how more developers are rapidly innovating with Google Cloud. This video is also subtitled in ...

Azure Machine Learning: Predict Who Survives the Titanic - Jennifer Marsman - Duo Tech Talk

Interested in doing machine learning in the cloud? In this demo-heavy talk, I will set the stage with some information on the different types of machine learning ...

Livestream Day 3: Stage 1 (Google I/O '18)

This livestream covers all of the Google I/O 2018 day 3 sessions that take place on Stage 1. Stay tuned for technical sessions and deep dives into Google's latest ...

Google Developer Days Europe 2017 - Day 1 (Auditorium)

Check in to the livestream to watch day 1 of GDD Europe '17! This livestream will cover all sessions taking place on the Auditorium stage of the ICE Congress ...

What's Next for the Web (GDD India '17)

Whether you work on e-commerce, media, gaming, or some other type of site, you need to know about the future of the web. In this video, Thomas Steiner ...