23/02/2023

Data infrastructure: MatchMaker looking for furnished appartment

New episode in the journey of our Head of Data Jérémy Perret, who attacks this week the infrastructure of the data manipulated by our algorithms.

Data infrastructure: MatchMaker looking for furnished appartment

Fifth week at Together

My mission is to relate brands together with the power of data, and here I am doing plumbing. That was the plan. A necessity, really.

It took me about three weeks, exploring brand data, then using standard techniques, to get a first experimental model. A small bunch of lines of code, that predicts pairs of brands that will have the highest probability to create a great partnership. It's far from perfect of course, but it still gives promising results, and it runs smoothly on my machine.

Sure, but... our clients don't have access to my machine. The raw results report is barely readable. I manually configured three quarters of my development environment. What I have isn't a product, not even a prototype. A proof of concept, maybe? To transmute my method into an actual service, I need to integrate it to a proper infrastructure. It was time to put my Data Engineer hat on, and start discussing some specifications with Jonas, my CTO.

It turns out, there are plenty of interesting subproblems to solve! First, putting my algorithm behind an API, an interface that the rest of our app will be able to query anytime. What kind of machine, in the cloud, does this run on? Second, managing data updates. New brands appear frequently, their public image evolves over time, so I need to find how to adapt my process in an automated and scheduled way. Third, ensuring a reasonable response time. My methods are simple and quick enough so far, but that won't last; I need to precompute as many results as I can, so that partnerships will be suggested with minimal wait.

All of this looks like plumbing, connecting pipelines of data so it goes in the right place, at the right time, in the right shape. To make databases and apps talk to each other properly, in sync. It is rather tedious to set up everything, but this infrastructure lays the groundwork for future improvements. I will be able to make that central algorithm better, while trusting its surrounding environment. I will be able to switch that specific component in place without having to rebuild everything else. I will save precious time, and headaches to the entire tech team.

Zooming out a little, what I end up with is a legible system. I can easily draw a diagram outlining all of my operations. I can set up usage and performance metrics that actually point to something. They will be my next step.

Grow your business together

Développez votre activité avec Together

Start for freeDémarrez gratuitement

together.do just went public!

During the beta period, the platform is available free of charge for companies to enroll, discover, and match with new partners, as well as create profile pages that disclose their partnership criteria

together.do vient d'ouvrir au public !

Pendant la période de bêta, la plate-forme est disponible gratuitement pour les entreprises afin de s'inscrire, de découvrir et de correspondre avec de nouveaux partenaires, ainsi que de créer des pages de profil pour partager leurs critères de partenariat

Last blog posts

See all
What KPIs to use to monitor e-commerce acquisition strategy ?

What KPIs to use to monitor e-commerce acquisition strategy ?

To grow online revenue, you need a way to measure our strategies' performances. Success comes from trying, learning, and implementing the lessons learned. These steps are one of the reasons why we use key performance indicators, or in short, KPIs.

Data infrastructure: MatchMaker looking for furnished appartment

Data infrastructure: MatchMaker looking for furnished appartment

New episode in the journey of our Head of Data Jérémy Perret, who attacks this week the infrastructure of the data manipulated by our algorithms.

A new era of growth is possible, and it relies on partnerships

A new era of growth is possible, and it relies on partnerships

The world is changing and is entering a new phase, abundance. As a result, the way we do business is changing. We are leaving the age of competition to enter the age of partnerships. It is a revolution, literally.

Une nouvelle ère de croissance est possible. Elle repose sur les partenariats.

Une nouvelle ère de croissance est possible. Elle repose sur les partenariats.

Le monde change et entre dans une nouvelle phase, celle de l'abondance. Nous quittons l'ère de la concurrence pour entrer dans l'ère des partenariats. C'est une révolution, littéralement.

Lire la suite

24/02/2023

La Technologie au Service des Partenariats E-Commerce

La Technologie au Service des Partenariats E-Commerce

L’union fait la force. Cet adage martial s'applique aussi parfaitement au e-commerce. Face à des coûts d’acquisition qui explosent et au pouvoir des marketplaces, les partenariats de marques sont aujourd’hui un outil très efficace, et la technologie un formidable levier d'efficacité.

Lire la suite

23/02/2023

Les e-commerçants en quête d’un second souffle

Les e-commerçants en quête d’un second souffle

Le pouvoir des GAFAM conjugué à la régulation de la publicité ciblée confrontent le e-commerce à une crise sans précédent. La co-acquisition semble être le meilleur moyen de leur donner un second souffle.

Lire la suite

23/02/2023