Published in The Startup·PinnedMember-onlyThe Modern Data Platform Design: a tool agnostic approachThe big data echosystem is still too big! There I said it. I still remember seeing this post years ago and as a young and upcoming data scientist and it resonated with me. When I tried to keep up to date with all the advancements in data infrastructure I felt…Data Engineering7 min readData Engineering7 min read
Published in The Startup·PinnedMember-onlyPySpark on macOS: installation and useSpark is a very popular framework for data processing. It has slowly taken over the use of Hadoop for data analytics. In memory processing can yield up to 100x speed compared to Hadoop and MapReduce. One of the main advantages of Spark is that no more need to write map…Spark4 min readSpark4 min read
Published in The Startup·Jan 24, 2021Member-onlyCI/CD Pipelines for Python Packages With Circle CI and CodeClimateIn software engineering, continuous deployment and integration is a growing trend consisting of frequently updating and releasing code via automation. …Software Development10 min readSoftware Development10 min read
Mar 5, 2019Member-onlyDocker: a PrimerDocker is an application allowing to manage Linux containers on top of an existing OS. It provides a virtualisation layer (the Docker Engine) and thus any command and operations ran inside the container remain the same regardless of the OS on which Docker is set up. …Docker7 min readDocker7 min read
May 28, 2018How to setup an AWS EC2 instanceThe recent developement in data storage and processing have been motivated by the increasing amount and complexity of data available to individuals and companies. Most of these recent advancements require sophisticated and powerful hardware. Aspiring data scientists must be able to understand and master these new tools. For instance, given…AWS6 min readAWS6 min read
May 7, 2018Classification with OpenCV3 C++ (2/2)Large data set with low variance: original dataset: k-nearest neighbours:Data Science3 min readData Science3 min read
May 7, 2018Classification with OpenCV3 C++ (1/2)OpenCV is an open source C++ library focusing on computer vision launched in 1999 by Intel research. It is written in C++ but bindings in Python and Matlab are available. The project has been supported by Willow Garage since 2008 and is under active development. OpenCV provides tools for many…Machine Learning7 min readMachine Learning7 min read
Aug 14, 2017Setting up Xcode for C++ projectsWhen I first started using Xcode for my C++ projects I was a bit overwhelmed by the settings interface; sure I had used Xcode heavily for Objective-C and then Swift project but most of the Build Settings are already set up to run any iOS/macOS app. For C++ however, it…I OS3 min readI OS3 min read
Jul 9, 2017Une introduction à ArmadilloArmadillo est une librarie template C++ avec une interface très complete pour le calcul matriciel et l’algèbre linéaire. Elle permet de rapidement obtenir un code fonctionel sans compromis sur la performance du language. Ce tutoriel couvre l’installation de cette librarie (sur macOS seulement pour le moment), l’execution de simple code…Tutoriel7 min readTutoriel7 min read
