Frank Nielsen: Information sciences seek methods to distill information from data to models.

Patryk Kocielnik

Writing with the hope that a record of the random things people do around can save some duplication of effort -- except for fun.

More posts by Patryk Kocielnik.

Patryk Kocielnik

15 Oct 2020 • 1 min read

In a recent study published in a scientific journal named Entropy, Frank Nielsen proposed the term "Information Sciences" to describe the common goal of several modern efforts to turn data into models:

In short, information sciences seek methods to distill information from data to models. Thus information sciences encompass information theory but also include the fields of Probability and Statistics, Machine Learning (ML), Artificial Intelligence (AI), Mathematical Programming, just to name a few.

This statement was included in Nielsen's article "An Elementary Introduction to Information Geometry", available to download directly from Entropy.

Frank Nielsen: Information sciences seek methods to distill information from data to models.

Patryk Kocielnik

Patryk Kocielnik

Jeremy Howard: In transfer learning you start with a model trained to do something, then fine-tune it.

Jeremy Howard: Once the data is there, there is very little to do afterwards.